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Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 
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Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )KI Responsive to communication(s) filed on 11 April 2005 . 
2a)D This action is FINAL. 2b)|3 This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 
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4) S Claim(s) 1-14 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) M Claim(s) 1-14 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) Q The specification is objected to by the Examiner. 

10)D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1121(d). 
1 !)□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 
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12)D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
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application from the International Bureau (PCT Rule 17.2(a)). 
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DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

I . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1 .17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1 .1 14, and the fee set 
forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on April 

I I , 2005 has been entered. 



Response to Amendment 

2. In response to the Office Action mailed January 13, 2005, applicant submitted an 
amendment filed on April 11, 2005, in which the applicant traversed and requested 
reconsideration with respect to claims 1 and 10-11. 

Response to Arguments 

3. Applicant(s) argue that Sadakuni, Holm, Tackett or Edatsune taken alone or in 
combination does not teach or suggest that the voice of said speech synthesizing 
apparatus is a function of said speech synthesizing and said personality information. 
However, the examiner disagrees. Holm teaches that Figure 1 illustrates a speech 
synthesizer that employs the prosody template technology. The personality information 
is obtained through intonation, stress pattern, pitch, etc. (column 3, lines 7-40 with 
column 8, line 61 - column 9, line 16), to insure a very natural prosody for the sentence. 
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The prosody (stress pattern, pitch, intonation etc.) allows personality, to prevent the 
robot from sounding monotone. 

Therefore, applicant's arguments filed April 11, 2005 have been fully considered 
but they are not persuasive. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 1-14 are rejected under 35 U.S.C. 103(a) unpatentable over Sadakuni 
(U.S Patent No. 6,446,056) in view of Holm et al. (U.S. Patent No. 6,260,016), 
hereinafter referenced as Holm in further view of Tackett et al. (U.S. Patent No. 
6,363,301), hereinafter referenced as Tackett and Edatsune (U.S. Patent No. 
5,802,488). 

Regarding claims 1,10 and 11 Sadakuni discloses an interactive artificial 
intelligence comprising: 

a behavior planning unit (Figure 1, element 7), which reads on the claimed 
"behavior-state changing means", responsive to a behavior event (column 8, lines 37-38 
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and 41-53), for changing a behavior state according to a behavior model (behavior 
modified by emotion; figure 3, element g and figure 12 with column 1 , lines 40-43); 

an emotion-generating unit (Figure 1, element 3), which reads on the claimed 
"emotion-state changing means" for changing an emotion according to the emotion 
model (figure 12); and 

selecting means selecting control information according to at least one of the 
behavior state (attack; column 5, lines 21-25), but Sadakuni lacks synthesizing means 
for synthesizing a speech signal wherein a voice of said speech synthesizing apparatus 
is a function of said speech synthesizing information and said personality information, a 
text generating means for generating text in response to said behavior event and 
substituting means having a number of word substitute dictionaries. 

Holm discloses synthesizing means (figure 1) for synthesizing a speech signal 
(column 4, lines 8-23), to generate a pronunciation of the word, 

wherein a voice synthesizing of said speech synthesizing apparatus is a function 
of said speech synthesizing information and said personality information (column 3, 
lines 7-40 with column 8, line 61 - column 9, line 16), to insure a very natural prosody 
for the sentence. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Sadakuni's invention such it discloses 
synthesizing means for synthesizing a speech signal, to generate synthesized speech, 
wherein the normally missing prosody information is supplied from the templates based 
on data extracted from human speech, as taught by Holm (column 8, lines 61-65), to 
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provide more natural sounding prosody through the use of prosody templates (column 
1 , lines 6-9), but Holm lacks a text generating means for generating text in response to 
said behavior event and substituting means having a number of word substitute 
dictionaries. 

Tackett discloses a text generating means for generating text (column 20, lines 
58-60) in response to said behavior event (user's language inappropriate, so user is 
kicked off the system by the robot; column 33, lines 8-12), to improve the robots 
behavior. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Sadakuni and Holm with a text generating 
means for generating text in response to said behavior event, to allow the robot to learn 
from interaction with user and improve its own behavior, as taught by Tackett (column 2, 
lines 65-67), but Tackett lacks substituting means having a number of word substitute 
dictionaries. 

Edatsune does not specifically disclose substituting means, having a number of 
word substitute dictionaries, for substituting a word or words included in the text with a 
word or words from the number of word substitute dictionaries in accordance with 
personality information. However, it is suggested that changing the levels/age is 
analogous to changing the personality. As the stuffed toy/robot grows up/matures, the 
vocabulary changes, which constitutes for the substitute dictionaries (column 12, lines 
13-32). 
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Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Sadakuni in combination with Holm and 
Tackett's apparatus, method and recording medium such that it discloses having a 
number of word substitute dictionaries, for substituting a word or words included in the 
text with a word or words from the number of word substitute dictionaries in accordance 
with personality information, to create a response content level for increasing the level 
response content as time changes and/or based on the number or types of phrases 
recognized (column 12, lines 13-32). 

Regarding claim 2, Sadakuni discloses an interactive artificial intelligence 
device, but lacks including one or more of the following items: a segment-data ID, a 
syllable-set ID, a pitch parameter, a parameter of intensity of accent, a parameter of 
intensity of phrasify, or an utterance-speed parameter. 

Holm discloses a speech synthesis system including at least one of a segment- 
data ID, a syllable-set ID (syllables enunciated), a pitch parameter (pitch rises and falls), 
a parameter of intensity of accent, a parameter of intensity of phrasify (intensity of 
syllables; column 2, lines 20-30), or an utterance-speed parameter (speech rate; 
column 8, line 49), to convey the reader's interpretation of the material. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Sadakuni's invention such that it includes at 
least one of a segment-data ID, a syllable-set ID, a pitch parameter, a parameter of 
intensity of accent, a parameter of intensity of phrasify, and an utterance-speed 
parameter, to insure a natural prosody, as taught by Holm (column 9, lines 11-16). 



Application/Control Number: 09/749,345 Page 7 

Art Unit: 2655 

Regarding claim 3, Sadakuni discloses an interactive artificial intelligence with 
detecting means for detecting external conditions (Figure 3, step a and column 9, lines 
10-19). 

Regarding claim 4, Sadakuni's interactive artificial intelligence discloses holding 
means for holding individual information (column 6, line 32 and column 5, lines 31-43). 

Regarding claim 5, Sadakuni's interactive artificial intelligence discloses counting 
means for counting elapsed time (column 4, lines 20-42) 

Regarding claim 6, Sadakuni discloses an interactive artificial intelligence device 
comprising at least one of the number of accumulating means for accumulating the 
number of times the behavior and emotion state changes (column 2, 14-19 and lines 
58-61). 

Regarding claim 7, Sadakuni in view of Holm and Tackett discloses everything 
as claimed in claim 1, but lacks wherein the personality information is included in the 
control information selected by the selecting means. 

Edatsune discloses interactive speech recognition wherein the personality 
information (response level) is included in the control information selected by the 
selecting means (column 12, lines 13-32), to recognize speech and produce sounds 
and actions in response to the recognition result. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Sadakuni in combination with Holm and 
Tackett's apparatus, method and recording medium wherein the personality information 
is included in the control information selected by the selecting means, to create a 
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response content level for increasing the level response content as time changes and/or 
based on the number or types of phrases recognized (column 12, lines 13-32) 

Holm discloses substituting means for substituting words included in the text 
(substitute word; column 9, lines 7-11), to insure a natural prosody. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Sadakuni's invention such that it discloses 
substituting means for substituting words included in the text, for providing more natural 
sounding prosody through the use of prosody templates. 

Regarding claim 8, Sadakuni discloses an interactive artificial intelligence, but 
lacks the converting means for converting the style of the text. • 

Holm discloses converting means for converting the style (prosody) of the text 
(column 1, lines 29-44). 

Therefore, It would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Sadakuni's speech synthesizing apparatus 
method and recording medium, for the purpose of supplying the system with requisite 
information concerning the number of syllables and stress patterns that fit the given 
emotion. 

Regarding claim 9, Sadakuni an interactive artificial intelligence that is a robot 
(column 1, lines 48-51 and column 18, lines 6-7). 

Regarding claims 12-14, Sadakuni in view of Holm and Tackett discloses an 
interactive artificial intelligence, but lacks wherein the personality information is 
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representative of one or more of the following items: type, gender, age, temperament, or 
physical condition. 

Edatsune does not specifically discloses the personality information is 
representative of age, however it is suggested that changing the levels/age is 
analogous to changing the personality. As the stuffed toy/robot grows up/matures, the 
vocabulary changes, which constitutes for the substitute dictionaries (column 12, lines 
13-32). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Sadakuni in combination with Holm and 
Tackett's apparatus, method and recording medium wherein the personality information 
is representative of one or more of the following items: type, gender, age, temperament, 
or physical condition, to create a response content level for increasing the level 
response content as time changes and/or based on the number or types of phrases 
recognized (column 12, lines 13-32). 



Conclusion 

6. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Jakieda R Jackson whose telephone number is 
571 .272.761 9. The examiner can normally be reached on Monday through Friday from 
7:30 a.m. to 5:00p.m. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David Ometz can be reached on 571 .272.7593. The fax phone number for 
the organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



JRJ 

April 19, 2005 




